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MEMORANDUM  FOR  THE  SECRETARY  OF  DEFENSE 

THROUGH;  Under  Secretary  of  Defense  for  Research  and  Engineering 

SUBJECT:  Report  on  the  Defense  Science  Board  1985  Summer  Study  on 
"Practical  Functional  Performance  Requirements"  ■  ACTION 
MEMORANDUM 


I  am  pleased  to  submit  this  final  report  on  the  1985  Defense  Science  Board 
Summer  Study  on  Practical  Functional  Performance  Requirements  chaired  by  Mr. 
Robert  A.  Fuhrman. 

1  believe  the  study  provides  important  new  insights  into  some  key  aspects  of 
the  acquisition  process  and  contains  sound  implementable  recommendations  which 
can  significantly  improve  that  process. 

As  you  know,  this  Study  was  briefed  to  the  Presidents’  Blue  Ribbon 
Commission  on  Defense  Management,  at  their  request.  Additionally,  at  the  request 
of  the  Under  Secretary  of  Defense  for  Research  and  Engineering,  we  have  initiated  a 
Task  Force  on  the  LHX  proeram  with  the  specific  goal  of  applying  these 
recommendations  to  the  LHX  requirements  process.  It  is  my  current  assessment 
that  this  effort  will  prove  to  be  highly  beneficial  to  the  Amy  and  the  DoD. 

I  recommend  you  read  Mr.  Fuhrman’s  forwarding  letter  and  the  Executive 
Summary  which  includes  the  Implementation  Plan,  and  sign  the  attached 
memorandum. 


Attachment 

a/s 


Charles  A.  Fowler 
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1  March  1986 


Mr.  Charles  Fowler 
Chairman 

Defense  science  Board 
The  Pentagon,  Room  3D1034 
Washington,  D.C.  20301 

Dear  Mr.  Chairman: 

Enclosed  with  this  letter  is  the  final  report  of  the  Defense 
Science  Board  Summer  Study  on  Practical  Functional  Performance 
Requirements.  It  expands  on  the  information  presented  in  August, 
provides  additional  background  data,  and,  as  appropriate, 
incorporates  the  suggestions  made  by  the  many  reviewers  from 
within  and  outside  government. 

The  panel  noted  significant  differences  in  the  development  process 
between  commercial  programs  and  military  problem  programs. 
Although  there  is  no  single  action  that  can  be  successfully 
implemented  to  solve  all  problems,  there  are  some  major  lessons 
that  can  be  judiciously  applied  to  military  programs.  Operational 
requirements  generation  should  be  iterative,  with  cost/capability 
trades  continued  during  development.  The  ciNCs,  in  their  role  as 
users,  should  become  more  involved  in  the  requirements  process. 
Schedule  should  be  considered  a  dominant  program  driver  after 
commencement  of  full  scale  development.  The  program  manager  must 
be  given  sufficient  authority  to  truly  manage  his  program;  he  must 
have  direct  access  to  a  person  with  major  authority  and  resource 
control  so  he  can  seek  help  when  it  is  needed. 

Our  recommendations  aim  at  strengthening  the  process  by  which 
requirements  are  generated,  iterated  and  implemented.  With 
effective  monitoring  and  follow-up  attention,  we  believe  they  hold 
tiie  promise  of  significantly  improving  the  procurement  process. 


I  want  to  make  special  mention  of  the  outstanding  contributions  of 
each  member  of  the  Summer  Study  panel,  its  working  group  and 
special  consultants,  and  the  very  fine  assistance  provided  by  the 
military  services  and  various  elements  of  the  Office  of  the 
Secretary  of  Defense  during  our  investigation.  Your  assistance 
and  encouragement  are  especially  appreciated. 

While  the  entire  panel  has  participated  in  the  generation  of  this 
report,  the  Summer  Study  Chairman  bears  principal  responsibility 
for  its  content. 


R.  A.  Fuhrman 
Summer  Study  Chairman 


Enclosure 
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PRACTICAL  FUNCTIONAL  PERFORMANCE  REQUIREMENTS 
EXECUTIVE  SUMMARY 


Background 

;This  DSB  summer  study  panel  was  asked  by  the  Under  Secretary  of  Defense  for 
Research  and  Engineering  to  examine  what  role  the  performance  requirements  for 
military  systems  plays  in  tne  problems  associated  with  the  current  systems 
acquisition  process.  He  also  asked  it  to  recommend  improvements  in  the  manner  in 
which  the  Department  of  Defense  determines,  prioritizes,  and  satisfies  its  official 
requirements.  Specifically,  the  Panel  was  asked  to  suggest  ways  by  which  the 
systems  acquisition  process  could  be  improved  by  changing  the  way  requirements 
are  generated,  documented,  and  implemented. 

To  satisfy  this  request,  the  Panel  was  first  broken  into  three  subpanels  for 
preliminary  data-gathering  and  analysis.  One  of  these  subpanels  performed  a 
broad  analysis  of  twenty-six  DOD  programs.  Another  studied,  in  depth,  five 
comparable  non-DOD  (mostly  commercial)  development  programs.  And  the  third, 
throught  direct  contact  with  all  the  top-level  U.S.  operational comanders  (the 
CINCs),  obtained  a  user's  perception  of  the  desired  degree  and  manner  of  user 
involvement  in  the  requirements  process  and  suggestions  for  improvement  in  this 
process.  <<■.  - 

The  Panel  also  received  in-depth  briefings  on  each  Service's  requirements  and 
acquisition  processes,  as  well  as  being  provided  by  them  with  eleven  special 
development  case  studies.  Third,  pertinent  briefings  by  OSD  and  OJCS  were 
provided,  in  addition  to  a  CIA  briefing  on  the  Soviet  acquisition  process,  Finally,  the 
Panel  received  personal  testimony  from  two  active  CINCs  and  the  Under  Secretary  of 
the  Army  on  the  topic  and  received  a  briefing  on  the  so-called  "streamlined 
acquisition  process  that  is  used  in  some  limited  access  programs. 

Findings  and  Recommendations 

From  this  background  and  its  own  experience,  the  Panel  concluded  overall 
that,  although  promising  efforts  are  currently  underway  in  all  of  the  Services  to 
improve  their  requirements  processes,  deficiencies  in  this  process  are  still  likely  to  be 
significant  contributors  to  continuing  increases  in  both  the  costand  length  of  time 
required  to  field  new  defense  systems.  In  particular,  it  believes  that  even  the 
improved  processes  will  continue  to  suffer  from:  (a)  a  failure  to  sufficiently  involve 
operational  users  in  a  direct  and  continuing  way  in  determining  and  prioritizing 
military  needs,  (b)  the  rigidity  with  which  requirements  statements  are  still 
expected  to  be  observed,  and  (c)  the  lack  of  adequate  iteration  of  official 
requirements,  before  they  are  formalized,  with  tnose  who  must  satisfy  them 
(acquirers  and  suppliers).  As  a  consequence,  the  Panel  anticipates  that  in  too  many 
cases  system  program  costs  will  still  be  driven  up  to  the  point  that  fielded  systems 
will  be  procured  in  insufficient  quantity  to  be  effective.  Alternatively,  it  believes 
they  might  take  so  long  in  development  that  when  fielded  will  not  be  able  to  meet 
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the  present  threat.  In  some  cases,  in  fact,  system  programs  could  still  become  so 
troubled  that  the  systems  involved  would  never  be  deployed. 

The  Panel  therefore  developed  two  generalized  models  that  demonstrate  the 
differences  it  found  in  the  way  requirements  are  determined  and  implemented  in 
the  acquisition  cycle  of  DOD's  problem  programs  and  the  way  they  are  dealt  with 
the  the  successful  non-DOD  and  the  streamlined  DOD  programs  studied.  Key 
advantages  of  the  non-DOD/commercial  model  overtne  problem  DOD  model 
include: 

*  a  powerful  executive,  who  has  authority  to  make  unchallengeable 
decisions,  settle  disputes  and  allocate  additional  resources;  sometimes 
the  Chief  Executive  Officer  (CEO).  He  can  directly  support  and  insulate 
from  external  pressures  the  Program  manager  as  critical  needs  arise; 

*  a  Program  Manager  who  has  continuity,  authority,  flexibility, 
accountability  for  decisions  and  direct  access  to  the  key  decision  maker 
(CEO); 

*  iterative  performance  requirements  analyses,  with  cost/user  utility  as  an 
important  factor; 

*  user  involvement  throughout  the  requirements  process; 

*  emphasis  on  holding  schedule  after  beginning  full  scale  development, 
with  use  of  block  upgrades  or  field  modifications  to  implement  increased 
capability. 

These  advantages  lead  to  the  Panel's  principal  recommendation:  the 
characteristics  of  the  acquisition  process  which  were  found  in  the  successful 
commercial  and  streamlined  DOD  cases  studied  would  be  applied  more  universally 
and  consistently  in  the  DOD  whenever  feasible. 

Thus,  the  Panel  concluded  that  the  military  porgram  manager’s  role  must  be 
strengthened  to  give  him  additional  authority  and  flexibility  to  make  trade-off 
decisions  on  his  program  and  direct  access  to  a  significant  authority  figure  to  whom 
he  can  go  if  he  needs  high  level  support.  It  further  concludes  that  program  risks 
must  be  identified  and  dealt  with  early  in  the  development  process;  requirements 
must  remain  flexible  and  be  iterated  as  long  as  possible;  ana  users  (CINCs)  must 
participate  in  program  dicisions  and  trade  -offs  that  can  affect  their  planned 
missions  or  operational  effectiveness  as  acquisitions  proceed,  not  simply  at  the 
beginning  and  at  the  end  of  the  process.  Finally,  schedule  (and  its  concomitant, 
cost)  should  be  considered  the  dominant  program  driver,  at  least  after 
commencement  of  full-scale  development. 

In  sum,  the  way  to  avoid  the  inflexible  contracts  with  inadequate  resources, 
overstated  performance  goals,  and  concealed  risks  found  in  the  DOD  problem 
programs  studied  is  to  establish  surrogate  CEOs  with  the  authority  ana 
responsibility  for  playing  the  role  of  their  commercial  counterparts,  reduce  the 
number  of  people  in  the  program  decision  chain  by  eliminating  the  layers  of  review 
and  control  between  program  managers  and  these  surrogate  CEOs,  control  staffs 
such  as  those  responsible  for  the  "ilities"  by  allowing  the  PMs  greater  authority  to 
make  dicisions  and  ultimately,  to  appeal  all  staff  requirements  to  the  CEO,  give  PMs 
more  flexibility  to  adjust  performance  to  hold  to  schedules,  and  find  ways  to  involve 
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users  more  throughout  the  acquisition  process.  Above  all,  providing  for  the 
flexibility  in  the  process  that  is  needed  to  deal  with  troubles  and  uncertainties,  and 
basing  pesonnel  performance  measurement  and  rewards  on  clear-cut  personal 
accountability  for  results,  rather  than  on  obeisance  to  the  letter  of  procedures, 
would  go  along  way  towards  moving  the  problem  model  towards  the  more 
successful  commercial  model. 


Implementation  Plan 

1.  Recommendation  :  Require  the  Military  Departmentsto  incorporate  the 
following  principles  into  their  respective  requirements  and  acquisition 
processes: 

a.  The  development  of  an  operational  requirement  should  be  an  iterative 
process  during  which  potential  solutions  to  the  operational  need  are 
evaluated  and  traded  off  with  respect  to  affordability,  schedule, 
performance  and  risk  prior  to  commitment  to  the  program. 

b.  After  program  initiation  and  prior  to  the  commencement  of  FSED, 
technical  risk  reduction  and  cost/capa biiity  tradeoff  efforts,  with  industry 
participation,  should  be  conducted.  Results  of  these  efforts  should  be 
used  to  fully  understand  risks,  ensure  clear  definition  of  program 
objectives,  produce  schedule  realism  and  apply  appropriate  incentives. 

c.  Upon  commencement  of  FSED,  schedule  should  be  considered  as  the 
dominant  program  driver  and  the  program  contracted  and  funded 
accordingly. 

d.  In  the  event  that  technological  opportunities  or  operational 
requirements  warrant  change,  block  upgrades  should  be  the  primary 
solution  to  avoid  schedule  delays. 

Action:  SEC  DEF  direct  the  Defense  Acquisition  Executive  to  revise  DoD 
Directive  5000.1  as  appropriate  and  require  the  Military  Departments  to 
incorporate  the  principles  enunciated  above  into  their  respective 
requirements  and  acquisition  processes. 

2.  Recommendation:  Require  the  Military  Departments  to  ensure  clear  lines  of 
accountability  and  authority  between  a  surrogate  CEO  (Chief  Executive  Officer) 
and  the  developing  activity  for  progam  management  and  execution. 

a.  Reduce  the  number  of  people  allowed  to  participate  in  the  decision 
process  and  reduce  the  number  of  layers  through  which  the  program 
manager  reports. 

b.  Reaffirm  developing  activity  and  program  manager  responsibility  for 
all  aspects  of  program  execution. 

c.  Provide  program  managers  direct  access  to  a  surrogate  CEO  who  has 
the  authority  and  control  of  resources  to  make  and  enforce  decisions 
regarding  trade-offs  between  performance,  schedule  and  cost. 

Action:  SEC  DEF  direct  the  Services  to  identify  their  top  ten  programs  and  fo 
them  designate  a  single  surrogate  CEO  (of  four  star  rank  or  equivalent)  with 
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the  authority  to  make  unilateral  decisions  regarding  tradeoffs  of 
performance,  costs  and  schedules.  Program  budgets  should  include  reserves 
for  technological  risk,  to  be  held  by  the  surrogate  CEO,  and  used  to  preserve 
schedule  to  tne  maximum  extent  possible. 

SEC  DEF  direct  the  Defense  Acquisition  Executive  to  update  DoD  Directive 
5000.1  to  include  this  recommendation. 

3.  Recommendation:  The  Secretary  of  Defense  take  corresponding  action  to 
reduce  05D  monitoring  staffs  and  excessive  program  review. 

Action:  SEC  DEF  direct  the  Defense  Acquisition  Executive,  as  DSARC 
Chairman,  to  ensure  that  the  milestone  review  process  for  major  system 
acquisitions  is  streamlined  and  that  excessive  program  review  is  avoided. 

4.  Recommendation:  The  Secretary  of  Defense  and  the  Joint  Chiefs  of  Staff  expand 
the  role  of  the  CINCs  in  the  overall  DoD  guidance  and  requirements  process. 

a.  Require  long  term  (10  years)  force  development  planning, 

b.  Staff  and  fund  CINCs  (commensurate  with  mission  and  areas)  to 
maintain  cognizance  of  programs  and  budget  priorities  and  tradeoffs. 

c.  Authorize  a  scientific/technical  advisor  reporting  directly  to  the  CINC. 

Action:  SEC  DEF  direct  the  ASD(C)  and  D,  PA&E  to  expand  the  role  of  the 
CiNCs  in  the  PPBS  process. 

SEC  DEF  direct  the  Chairman,  Joint  Chiefs  of  Staff  to  examine  how  best  to 
enable  CINCs  to  carry  out  this  expanded  role  and  adjust  CINC  staffing  levels  in 
Joint  Manpower  Programs  to  meet  this  goal.  Include  authorization  for  a 
scientific/technical  advisor  for  each  CINC. 

5.  Recommendation:  The  Secretary  of  Defense  direct  Departments  and  Agencies 
to  obtain  CINC  review  and  comment  on  requirements  and  programs  affecting 
their  commands. 

a.  In  timing  (IOC  and  FOC)  -technology  -totals  (quantity). 

b.  In  priorities  and  tradeoffs. 

c.  Interoperability  validations. 

Action:  SEC  DEF  direct  the  Defense  Acquisition  Executive  to  revise  DoD 
directive  5000. 1  to  require  the  Military  Departments  and  Defense  Agencies  to 
obtain  CINC  comments  and  reviews  on  requirements  and  programs  affecting 
their  commands.  Revise  5000. 1  to  ensure  DSARC  I  and  II  review  the  trade-offs 
between  the  relaxation  of  the  principle  technical  cost  drivers  and  changes  in 
procurable  quantities. 

SEC  DEF  direct  the  DSARC  I,  and  II  to  include  a  Chairman,  Joint  Chiefs  of  Staff 
report  on  cost,  performance,  schedule  and  quantity  trade-offs  and  their 
impact  on  mission  area  capability. 
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National  Airspace  System  (NAS)  provides  the  technical  means  by  which  the  FAA  controls  air 
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FEEDBACK  IMPROVING  BUT  STILL  OFTEN  "FORMAL"  ONLY  AND  NOT 
ROBUST  ENOUGH  TO  ALLOW  CINC  TO  INFLUENCE  PROGRAM  AND 
BUDGET  DECISIONS 
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FAILED  ITS  ULTIMATE  TEST 


In  particular,  the  unified  CWCs  are  not  responded  to  consistently.  They  are  not  presently  staffed  to  produce  quality 
iri>uts.  They  can't  track  progress  to  identify  what  is  going  on  with  their  requirements. 
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SYSTEM  MODELS 
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In  contrast,  in  the  Problem  Program  Model  there  are  many  more  people  involved,  they  have 
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CHANGE,  BLOCK  CHANGES  SHOULD  BE  PRIMARY  SOLUTION- 
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CINCs  represent  the  most  knowledqeable  user  community.  OSD  and  l he  services  must  strive  to 
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THE  JNDER  SECRETARY  OF  DEFENSE 
WASHINGTON,  DC  20301-3010 

$  2  MAY  '365 


MEMORANDUM  FOR  CHAIRMAN,  DEFENSE  SCIENCE  BOARD 

SUBJECT:  Defense  Science  Board  Summer  Study  on  Practical 
Functional  Performance  Requirements 


You  are  requested  to  convene  a  Defense  Science  Board  Summer 
Study  on  weapon  systems  functional  performance  requirements.  1 

Inherent  program  costs  are  driven  by  technical  functional 
performance  requirements,  e.g.,  maximum  speed,  accuracy,  etc. 

System  technical  performance  requirements  are  often  fixed  before 
cost  and  schedule  implications  are  well  understood.  Although 
the  Services  are  responsible  for  establishing  overall  military 
requirements  needed  to  meet  the  threat  ,  these  requirements  may 
be  met  by  various  combinations  of  the  technical  performance 
parameters,  which  will  result  in  different  program  costs, 
schedules  and  risks. 

This  Summer  Study  should  address,  but  not  be  limited  to, 
the  following  questions:  j 

1.  What  is  the  impact  of  the  process  for  establishing 
military  system  functional  performance  requirements  on  program  •J 

cost  and  schedule,  and  what  improvements  can  be  made  to  ensure 
stated  technical  performance  requirements  are  based  on  trade¬ 
offs  to  better  optimize  system  performance,  operability, 
supportabiiity ,  cost,  and  schedule?  In  particular,  what  should 
be  done  to  ensure  sensitivity  studies  and  "marginal  returns" 
evaluations  are  integrated  into  the  process  for  establishing 
system  technical  functional  performance  requirements?  * 


2.  Is  it  feasible  to  establish  initial  program  technical 
performance  "requirements"  as  goals  or  "quasi-requirements" 
during  the  concept  and  early  development  phases  of  programs,  and 
establish  firm  performance  requirements  only  after  advanced 
development  has  provided  the  information  needed  to  establish 
cost,  schedule  and  technical  risks  with  high  confidence?  If  so, 
what  changes  need  to  be  made  to  make  this  happen? 


3.  What  is  the  impact  of  the  operational  user  (e.g.,  the 
CINCs),  in  establishing  weapon  system  performance  "requirements" 
and  what  can  be  done  to  improve  user  impact? 
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The  process  for  establishing  subsystem  and  component 
technical  performance  requirements  should  also  be  addressed. 

The  study  should  consider  the  implications  of  the  Pre-Planned 
Product  Improvement  (P3/I)  initiative  on  the  process  for 
establishing  performance  requirements.  Specific  comparisons  of 
the  system  performance  requirements  and  definition  processes 
used  in  several  large  commercial  aerospace  and  electronics 
programs  with  those  used  in  similar  military  programs  should  be 
made  to  reveal  good  approaches  from  the  commercial  sector. 

This  Summer  Study  is  sponsored  by  the  USDRE.  Mr.  Robert  A. 
Fuhrman  has  agreed  to  serve  as  Chairman  of  the  Task  Force  and 
Mr.  John  E.  Smith,  Director,  Major  Systems  Acquisition,  OUSDRE, 
will  be  the  Executive  Secretary.  Lt.  Colonel  Herbert  R. 

Vadney,  USAF  will  be  the  DSB  Secretariat  Representative.  It  is 
not  anticipated  that  your  inquiry  will  need  to  go  into  any 
"particular  matters"  within  the  meaning  of  Section  208  of  Title 
18,  U.S.  Code. 


Junta  P.  Wade,  Jr. 
Acting 
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PRACTICAL  FUNCTIONAL  PERFORMANCE  REQUIREMENTS 
PANEL  MEMBERSHIP 


Robert  A.  Fuhrman,  Chairman 
Group  President 
Lockheed  Missiles,  Space  and 
Electronics  Systems  Group 

LtCol  Herbert  R.  Vadney 

Defense  Science  Board  Representative 


OTHER  DSB  MEMBERS 
William  A.  Anders 

Executive  Vice  President,  Aerospace 
Textron  Corporation 

Malcolm  R.  Currie 
Executive  Vice  President- 
Hughes  Aircraft  company 

Daniel  J.  Fink 

D.  J.  Fink  Associates,  Inc. 

Robert  J.  Hermann 

Vice  President -Advanced  Systems 

United  Technologies  Corporation 

William  J,  Perry 
Partner 

Hanbrecht  &  Quist 


OTHER  PRIVATE  SECTOR  MEMBERS 
Rowland  Brown 

Vice  President-Design  Technology 
Boeing  Coimercial  Airplane  Company 

Robert,  r,  Everett 
President 

The  Mitre  Corporation 


MILITARY  REPRESENTATIVES 

VADM  Albert  J.  Baciocco,  Jr.,  USN 

MGEN  Robert  D.  Hammond,  USA 


Norman  R.  Augustine,  Vice  Chairman 
Senior  Vice  President 
Martin-Marietta  Corporation 

John  E.  Smith,  Executive  Secretary 
Director,  Major  Systems  Acquisition 
OUSDRE 


Vincent  N.  Cook 
President 

Federal  Systems  Division 
International  Business  Machine  Corp. 

Gen.  Russell  E.  Dougherty,  USAF  (Ret.) 
Executive  Director 
Air  Force  Association 

Alexander  H.  Flax 

President  Emeritus 

Institute  for  Defense  Analysis 

Admiral  Isaac  C.  Kidd,  Jr.,  USN  (Ret  .) 


LGen.  Philip  D.  Shutler,  USMC  (Re".) 
Board  of  Directors 
Syscon  Corporation 


MGEN  Ray  M.  Franklin,  USMC 
MGEN  Harold  J.M.  Williams,  USAF 
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WORKING  GROUP 


A1  Babbitt 

Vice  President-Advanced  Systems 
International  Business  Machine  Corporation 

Col  Francis  X.  Chambers,  Jr.,  USMC 


CDR  David  L.  Nordean,  USN 
Col  Winslow  E.  Reither,  USAF 


Richard  Schwartz 

Member  of  Research  Staff 

Institute  for  Defense  Analyses 

Norman  Waks 

Chief  Management  Scientist 
The  Mitre  Corporation 


Allen  Carley 

Central  Intelligence  Agency 

Willard  H.  Mitchell 

Vice  President-Government  Requirements 

Lockheed  Aeronautical  Systems  Group 

James  O'Brien,  USA 

Daniel  A.  Rusk in 

Vice  President -Government  Requirements 
Lockheed  Missiles,  Space  and 
Electronics  Systems  Group 

Col  Stan  Sheldon,  USAF  (OJCS) 
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SUMMER  STUDY  PRESENTATION  AGENDAS 


June  19,  1985  -  Pentagon 
Navy  Requirements  Process 

Air  Force  Requirements  Process 

Army  Requirements  Process 

Marine  Corps  Requirements 
Process 

Policy-Front  End  Acqusition 
Pr  ocess 

Joint  Requirements  and 
Management  Board 

USDRE  and  DSARC  Process 

DRB/PBRS  and  OSD  Role 


R/Adm.  John  T.  Parker 
Dep.  Director,  RDT&E  (OP98) 
Staff,  Chief  Naval  Ops 

M/Gen . H . J . M. ( Mac )  Williams 
Director,  Operational  Rqmt.s 
Air  Force  DC^/RDA 

Jack  Harris 
Headquarters,  TRADOC 
Systems  Mgt.  Director 
Army  DCS/Combat.  Development 

L/C  E.c.  Brown 
DCS/Research,  Dev.s,  studjes 
Headquarters,  Marine  Corps. 

John  E.  Smith 
Director,  Major  Systems 
Acquisition,  USDRE 

M/Gen.  H.L.  Olson 
Director,  Strategic  Plans 
it  Resource  Analy.,  JCS 

Dr.  James  Wade 
USDRE  (Acting) 

Dr.  David  Chu 

DR3  Executive  Secretary 


July  16,  1985  -  Sunnyvale,  Califo 

Satellite  Laser  Communications 
Program  Requirements-An  Example 

Commercial  Case  Review 

Army  Accelerated  Procurement 
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Cmdr.  Ralph  Chatham 
Laser  Satellite  Comm. 
Program  PM,  darpa 

Peter  Bohacet,  AT&T 
Frank  Willingham,  MITRE 
Kenneth  Homon,  SBS 
Pow  Brown,  Boeing 
A1  Babbitt,  IBM 

M/Gen.  R.  Hammond 
Headquarters,  Army  Material 
Command 
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July  2  9,  1985  -  San  Diego 


Army  Procurement  James  Ambrose 

Undersecretary  of  Armv 


July  30,  1985  -  San  Diego 
Air  Force  Requirements  Examples 

Twenty  Six  Military  Cases 

USSR  Requirements  Process 

July  31,  1985  -  San  Diego 
Air  Force  Procurement 

Navy  Procurement 

Navy  Requirements  Examples 

CINC  Perspective 

August  1,  1985  -  San  Diego 
Army  Requirements  Examples 

Navy  Requirements  Examples 


Col.  Winslow  E.  Rei  t.her 
Headquarters,  USAF/RDQ 

Richard  Schwart2 
IDA 


Allen  Carley 
CIA 


B/Gen.  Gerry  Schwankl 
Headquarters,  USAF/RDA 

R/Adm.  J.B.  Wilkinson 
Vice  Commander,  Naval  Air 
Systems  Command 

Capt .  Bruce  C.  Marshall 

Capt .  Ern  Lewis 

Naval  Air  Systems  Command 

Gen,  R.  Herres 
CINC  NORAD/Space 


M/Gen,  R.  Hammond 
Headquarters,  Army 
Material  Command 

Capt.  R.  Welborn 
Program  Manager 
PMS406  -  SYSCOM 
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SYSTEM  MODELS 


A  review  of  the  case  studies  indicates  that  there  are  two 
general  models  of  the  acquisition  process,  one  of  which 
characterizes  the  commercial  process  (at  least  for  the  successful 
programs  studied)  and  one  which  characterizes  the  DoD  process  (at 
least  for  the  unsuccessful  programs  studied) .  We  do  not  want  to 
imply  that  all  commercial  programs  are  alike  or  are  successful, 
nor  do  we  imply  that  all  DoD  programs  are  alike  or  unsuccessful. 
We  do  see  certain  fundamental  differences  and  believe  that  the 
closer  a  program  is  to  the  "Commercial  Model*  the  more  likely  it 
is  to  succeed  and  the  closer  it  is  to  the  "Government  Model"  the 
more  likely  it  is  to  fail. 

The  Commercial  Model  is  shown  in  Figure  1.  There  are  three 
major  players,  a  Program  Manager  or  PM  who  does  the  work,  a  Chief 
Executive  Officer  or  CEO  who  makes  the  major  decisions  and  a  user 
or  group  of  users  who  decide  the  ultimate  success  or  failure  of 
the  program.  There  are  many  minor  players,  of  course,  including 
inside  staffs,  government  regulators,  consumer ists,  etc.,  but  one 
of  the  major  advantages  of  the  Commercial  Model  is  that  the  minor 
players  play  a  minor  role. 

The  first  step  in  the  model  is  for  the  PM  to  put  together  a 
realistic  proposal  for  the  CEO  to  consider.  The  PM  knows  what 
resources  and  what  technologies  are  available,  backed  where 
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necessary  with  company  R&D  funds.  The  PM  pays  a  lot  of  attention 
to  the  users  wants  and  needs  because  he  knows  that  they  will 
eventually  decide  whether  or  not  to  buy.  How  he  involves  the 
users  is  up  to  him  but  involve  them  he  must  if  he  is  to  succeed. 
The  PM  is  motivated  to  be  realistic  about  performance,  cost  and 
schedule,  both  because  he  will  have  to  carry  out  the  program  if 
it  is  approved  and  because  his  job  is  dependent  on  the  merits  of 
his  proposal  and  not  simply  on  whether  it  is  accepted. 

The  CEO  has  clear  cut  decision  authority.  He  may  have  to 
deal  with  Boards  of  Directors,  bankers,  etc.,  but  they  are  just 
elements  of  his  problem.  He  must  decide  whether  or  not  to 
proceed  and  his  decision  must  stick.  The  CEO  has  alternatives  to 
proceeding?  he  can  send  the  proposal  back  for  redo  or  he  can 
cancel  the  program  and  put  his  resources  somewhere  else.  His 
future  depends  on  whether  programs  he  approves  are  ultimately 
successful,  not  on  whether  or  not  he  goes  ahead  with  them. 

The  CEO  and  the  PM  must  have  a  close  working  relationship, 
direct  access  to  each  other,  and  mutual  trust.  The  CEO  can  have, 
and  probably  will  have,  advice  from  many  others  which  he  can  take 
into  account  or  not,  as  he  wishes. 

A  decision  to  proceed  is  a  firm  decision  based  on  a 
realistic  commitment  on  the  part  of  both  the  CEO  and  PM.  This 
commitment  involves  a  clear  agreement  on  authority, 
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responsibility  and  flexibilty  an  understanding  of  the  risks 

involved  and  an  agreement  on  the  resources  to  be  made  available , 
including  adequate  resources  to  cope  with  contingencies,  in  turn 
the  PM  commits  himself  to  performance,  cost  and  schedule.  Note 
that  the  process  of  reaching  this  decision  is  really  a  single 
step  although  it  may  be  lengthy  and  expensive  and  go  through  many 
iterations. 

The  acquisition  of  a  complex  system  involves  many 
uncertainties.  The  PM  copes  with  these  in  two  ways.  First,  he 
has  some  flexibility  in  performance  goals  and  second,  he  has  some 
resources  to  reduce  these  uncertainties  and  to  cover 
contingencies.  In  general  he  holds  schedules  and  relaxes 
performance  if  he  must,  both  because  timing  is  important  in  a 
competitive  market  and  because  holding  schedule  tends  to  hold 
cost.  If  he  gets  in  trouble  he  goes  back  to  the  CEO  who  can 
grant  additional  resources  of  time  or  money  or  can  adjust 
performance  goals.  If  things  get  too  far  out  of  line  and  the  CEO 
decides  the  program  no  longer  makes  sense,  he  can  cancel. 

Once  again  the  CEO  and  the  PM  must  have  a  close  working 
relationship.  The  CEO  must  be  kept  informed  and  the  PM  must  be 
able  to  get  help  rapidly  and  reliably  if  he  needs  it.  The 
principle  is  one  of  a  joint  activity  toward  a  common  goal.  A 
program  failure  is  a  failure  of  both  CEO  and  PM. 
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The  staffs  and  inspectors,  test  groups  and  ilities  groups 

exist,  but  are  insulated  from  the  PH  by  the  CEO.  The  staffs  can 
talk  to  the  PM  and  comment  and  advise  but  cannot  direct  the  PM 
without  going  through  the  CEO.  Only  the  PM  and  the  CEO  can  make 
decisions;  they  have  the  responsibility  and  therefore  the 
authority . 

When  the  development  is  complete,  the  product  is  produced 
and  delivered  to  the  users.  It  is  fundamental  to  the  model  that 
the  users  have  alternatives  to  buying  the  product.  They  can  buy 
from  a  different  source  or  spend  their  money  in  some  entirely 
different  way.  This  user  choice,  or  competitive  market,  is  what 
really  makes  the  system  work.  The  CEO/PM  combination  must 
seriously  consider  the  users  wants  and  needs,  must  make  realistic 
plans  and  commitments,  must  hold  to  costs  and  schedules,  must 
fend  off  the  nit-pickers  and  keep  the  program  under  control  or 
they  cannot  hope  to  sell  it  in  the  end. 

The  DoD  Model  is  shown  in  Figure  2.  There  are  many  more 
people  involved,  they  have  far  less  continuity  of  position,  and 
they  have  different  and  sometimes  conflicting  degrees  of 
authority,  responsibility,  and  interests. 

The  DoD  process  for  reaching  agreement  on  what  is  to  be 
acquired  really  involves  two  steps.  It  begins  with  a  competition 
for  funds,  carried  out  in  a  highly  political  environment 
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involving  the  services,  OSD,  OMB,  and  the  Congress.  There  are 
many  alternative  uses  for  the  funds  proposed  by  both  government 
and  industry  for  similar  and  different  products.  There  are  great 
pressures  to  overpromise  in  order  to  survive  the  competition. 
Since  the  decisions  are  made  by  political  processes  among  a  large 
and  diverse  group  of  people,  there  is  little  presssure  to 
discipline  the  process  and  to  enforce  realism.  Clear-cut  designs 
to  meet  the  requirements  are  not  allowed  because  they  would 
interfere  with  the  next  step  --  competitive  source  selection. 

The  result  is  a  firm  over-stated  requirement  which  too  frequently 
can  neither  be  met  nor  changed. 

Note  that  in  this  second  model  there  is  no  equivalent  to  the 
commercial  CEO.  Although  the  DoD  is  nominally  a  hierarchical 
authoritative  organization,  it  is  very  difficult  in  a  democracy 
for  anyone  to  make  a  controversial  decision  stick.  The 
successful  commercial  programs  we  looked  at  were  of  great 
importance  to  the  companies  involved  and  therefore  to  the  CEO. 
There  is  hardly  any  single  program  in  DoD  of  equivalent 
importance  to  Service  Secretaries,  let  alone  to  the  Secretary  of 
Defense.  DoD  has  too  many  important  programs  for  such  officials 
to  keep  track  of  them  in  detail. 

The  second  step  is  to  hold  a  competition  among  potential 
suppliers.  The  requirement  is  firm  and  difficult  or  impossible 
to  meet,  and  the  contractors  are  under  great  pressure  to 
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overestimate  what  they  can  do  and  to  underestimate  what  it  will 
cost.  Although  the  requirement  is  firm,  the  decision  to  proceed 
with  the  program  is  not.  The  losing  players  in  the  first  step 
are  still  around  and  hoping  for  another  chance.  It  is  difficult 
for  the  PM  to  be  realistic  and  he  has  no  CEO  to  help  him. 

The  result  is  an  inflexible  contract  with  inadequate 

F 

resources,  overstated  performance  goals,  and  concealed  risks.  The 
PM  has  little  ability  to  cope  with  the  inevitable  troubles.  He 
tends  to  keep  these  to  himself  because  reporting  them  gets  him 
much  attention  and  little  help.  When  the  trouble  gets  so  bad 
that  it  can  no  longer  be  kept  quiet,  it  is  extremely  expensive  to 
fix. 


Staffs  and  ilities  groups  are  numerous  and  continually 
harass  the  PM  who  has  little  protection  from  them.  Many  of  them 
were  established  in  the  hope  of  preventing  past  troubles  and  have 
authority  to  interfere  but  no  responsibility  for  getting  out  a 
product.  Although  the  PM's  commitments  up  are  firm,  commitments 
down  are  not,  and  changes  in  funding  are  common.  The  PM  is 
usually  forced  to  hold  performance  constant  so  trouble  results  ir 
slipping  schedules  and  rising  costs. 

Eventually,  after  much  difficulty,  the  product  reaches  the 
user.  The  situation  is  now  reversed;  the  PM  has  the  advantage 
because  the  user  has  no  alternative  but  to  accept  it  or  do 
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without.  The  more  fuss  the  user  makes  about  the  product,  the 
longer  it  will  take  to  fix  it,  the  more  it  will  cost  and  the 
fewer  he  will  get.  The  user's  ability  to  influence  the  design  is 
limited  throughout  the  process.  It  is  probably  greatest  in  the 
fist  stage,  depending  on  how  much  political  influence  the  user 
has  and  is  willing  to  expend.  His  influence  gets  less  as  time 
goes  on. 

We  would  hardly  claim  that  all  DoD  programs  go  according  to 
this  model.  We  all  know  of  successful  high  priority  programs 
that  have  avoided  many  of  these  difficulties.  Yet  it  is  obvious 
that  successful  programs  tend  to  be  like  the  Commercial  Model 
which  is  driven  by  market  forces,  rather  than  like  the  Government 
Model  which  is  not.  To  improve  the  DoD  process,  we  should  move 
it  toward  the  Commercial  Model  insofar  as  that  is  possible. 

Unfortunately,  normal  human  reactions  are  in  the  opposite 
direction.  Bad  prior  decisions  lead  to  adding  more  people  to  the 
decision  process,  which  is  exactly  the  wrong  thing  to  do.  As  a 
general  rule,  the  more  people  involved,  the  worse  the  decision. 
Any  person  or  group  added  to  the  current  process,  no  matter  how 
able  and  motivated,  will  make  things  worse.  We  need  fewer  people 
in  the  decision  process,  not  more. 

Inefficiencies  and  high  coats  lead  to  demands  for  more 
competition,  but  competitions  in  promises  do  not  help.  The 
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two-step  process  creates  a  separation  between  the  funding 
decision  and  the  source-selection  or  design  decision  makes  it 
extremely  difficult  to  get  a  realistic  match  between 
requirements#  costs#  and  schedules.  In  many  cases,  less  formr^, 
but  no  less  real  competitions  earlier  in  the  process  would  help. 

Missed  goals  lead  to  demands  for  firmer  contracts  within 
DoD,  and  between  DoD  and  industry#  but  there  is  now  inadequate 
flexibility  to  cope  with  troubles,  and  still  less  flexibility 
will  only  make  matters  worse. 

Unsatisfactory  performance  in  the  field  leads  to  demands  for 
more  operational  test  and  evaluation,  but  OT&E  will  not  help  the 
user  if  he  has  no  alternatives.  The  lack  of  user  alternatives 
leads  to  lack  of  user  influence#  which  leads  to  lack  of  realism 
throughout  the  process. 

What  should  we  do?  We  could  start  by  not  making  things 
worse.  We  could  review  the  current  process  and  make  it  .ore  like 
the  Commercial  Model  where  we  can.  In  particular,  we  could 
provide  for  clear-cut  personal  accountability  for  results  and 
less  obeisance  to  the  letter  of  procedures.  In  addition,  we 
could  reduce  the  number  of  people  in  the  decision  chain  by 
establishing  Surrogate  CEOs  with  the  authority  and  responsibility 
to  play  the  role  of  their  commercial  counterparts.  We  could  give 
the  PM  more  flexibility  to  adjust  performance  to  hold  to 
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schedules  and  costs.  We  could  find  ways  to  involve  users  more 
throughout  the  acquisition  process  and  to  give  them  alternatives 
and  the  chance  to  say  that  they  will  not  accept  a  product.  None 
of  these  are  easy;  but  they  would  at  least  be  in  the  right 
direction . 

Surrogate  CEQs 

As  discussed  above,  one  of  the  striking  differences  between 
the  Commercial  and  the  Government  Models  is  the  role  of  the  CEO. 
There  is  no  equivalent  to  the  CEO  in  the  DoD.  There  are  many 
important  programs  in  DoD  and  nwny  important  people.  No  one 
person  has  the  authority  to  make  firm  decisions.  Decisions  are 
made  by  a  large,  diffuse  group  that  acts  something  like  an 
extended  committee  and  that  lacks  clear-cut  responsiblity  and 
accountability.  The  DoD  itself  exists  in  a  political  environment 
that  further  smears  out  the  decision  making  process.  As  a 
result,  decision-making  is  lengthy  and  uncertain.  The  players 
change  and  the  decisions  tend  to  change  with  them.  The  Program 
Manager  is  separated  from  the  top  level  of  the  DoD  by  many 
intermediate  layers,  all  of  whom  must  be  dealt  with,  none  of  whom 
can  say  yes,  but  most  of  whom  can  say  no.  Decisions  are  late, 
inconsistent,  and  untrustworthy. 

The  Commercial  Model  demonstrates  that  both  an  accountable 
PM  and  a  CEO  who  can  make  firm  decisions  are  needed.  Increasing 
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the  authority  of  the  PM  alone  will  not  solve  the  problem. 

Attempts  to  streamline  the  process  and  to  connect  the  PM  more 
directly  to  the  top  of  the  DoD  have  not  been  successful  except  in 
extraordinary  cases.  There  are  too  many  programs  for  the  top 
level  to  understand  in  detail.  They  must  rely  on  their  staffs 
and  authority  rediffuses  in  the  bureaucracy. 

The  Task  Force  suggests  establishing  what  we  have  called 
Surrogate  CEOs.  These  are  individuals  who  have  been  delegated 
authority  and  responsiblity  to  act  as  decision-makers  for  one  or 
a  few  programs.  The  PMs  should  report  directly  to  them  on 
program  matters.  The  Surrogate  CEO  should  make  decisions  on 
matters  for  which  he  has  authority,  insulate  his  PMs  from  the 
staffs,  and  deal  with  upper  echelons  as  necessary.  His  success 
will  depend  on  how  much  authority  he  really  has,  to  adjust 
performance  and  schedule,  provide  additional  resources  if  needed, 
make  or  approve  tradeoffs.  If  he  is  responsible  for  only  a 
single  program  or  for  a  group  of  separate  programs,  his  ability 
to  provide  resources  will  be  limited.  If  he  has  responsibility 
for  a  group  of  related  programs  he  could  tradeoff  among  them  and 
could  be  more  effective.  Too  often  today,  what  we  call  systems 
do  not  provide  any  military  capability  in  themselves.  They  are 
only  components  of  larger  systems  which  are  often  left  undefined. 
A  Surrogate  CEO  with  a  group  of  related  programs  might  be  able  to 
help  develop  real  military  capability  in  his  assigned  area. 
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It  is  not  of  first  importance  where  the  Surrogate  CEO  sits 

in  the  hierarchy.  The  important  things  are  that  the  Surrogate 
CEO  should  have  appropriate  background  and  the  confidence  of  the 
community  so  that  he  can,  in  fact,  be  delegated  adequate 
authority,  and  that  he  have  few  enough  programs  under  him  so  that 
he  can  understand  and  keep  adequate  track  of  each  in  addition  to 
his  other  respoonsibilities  (in  general,  Surrogate  CEO  is  not  his 
full  time  job) . 

A  supervisor  or  commander  in  the  current  DoD  structure  is 
not  equivalent  to  a  Surrogate  CEO  because  he  does  not  have  the 
necessary  delegated  authority.  In  general,  the  commander  of  a 
development  organization  is  a  kind  of  super  PM  whose  superior 
rank  and  experience  can  be  used  to  assist  the  PMs  under  his 
direction,  and  who  can  assign  and  organize  the  people  resources 
available  to  him.  He  does  not  have  any  more  authority  over 
performance,  cost,  and  schedule  of  his  progrums  than  his  PMs  do. 
He  cannot  transfer  funds  among  programs  and  he  has  almost  no 
discretionary  money  under  his  control.  His  control  of  staff  and 
monitoring  groups  is  minimal.  He  is  overcommitted  and  has  almost 
no  flexibility. 

If,  in  spite  of  these  drawbacks,  commanders  of  development 
agencies  were  asked  to  act  as  Surrogate  CEOs,  it  probably  would 
avoid  confusion  about  who  the  PM  reports  to.  However,  a 
commander  of  a  large  organization  cannot  act  as  Surrogate  CEO  for 
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More  than  a  few  programs,  and  he  would  have  to  recognize  that  he 
would  have  subordinates  who  are  Surrogate  CEOs  for  other  programs 
over  which  the  he  has  no  program  authority.  This  points  out  the 
essence  of  the  Surrogate  CEO  idea,  which  is  not  that  PH  reports 
to  him,  but  that  he  has  been  delegated  the  authority  to  make 
decisions  about  the  program.  The  law  of  conservation  of 
authority  says  that  this  delegated  authority  must  come  from 
somewhere  and  it  must  come,  in  fact,  from  the  Surrogate  CEO's 
superiors  and  from  the  staffs  and  regulatory  bodies  in  the 
government.  These  people,  in  the  manner  of  all  human  beings, 
will  resist  giving  up  authority  ever  when  they  understand  that 
their  previous  activities  have  been  harmful  rather  than  helpful. 
Delegation  must  begin  at  the  top.  If  the  most  senior  people  will 
really  delegate  their  authority  and  insist  that  it  be  further 
delegated  to  Surrogate  CEOs,  there  is  a  chance  the  idea  will 
succeed.  There  will  still  be  plenty  of  other  things  for  the 
senior  people  to  do. 
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There  is  a  .logical  sequence  of  research,  requirement,  design 
engineering,  development  and  test  phases  that  is  followed  by  the 
U.S.  and  tne  USSR  in  tne  acquisition  of  a  major  military  system, 
It  follows  that  there  are  similarities  in  the  processes  each 
country  uses  to  acquire  its  new  and  modernized  systems.  On  the 
other  hand,  there  are  differing  economic,  industrial,  management, 
and  incentive  systems  in  the  U.S.  and  the  USSR  that  have  resulted 
in  different  approaches  in  National  management  ana  budgeting,  and 
system  design,  management  and  style.  The  following  sections 
highlight  the  major  similarities  and  differences  found  during  this 
st  udy . 

SIMILARITIES 

Both  the  U.S,  and  the  USSR  have  standardized  systematic  military 
system  acquisition  processes,  and  although  the  structures  or 
phases  of  the  processes  may  differ,  they  are  functionally  very 
similar.  Features  that  are  similar  in  each  process  are: 

o  A  research  base  of  developing  technologies  to  be  used  in 

weapon  system  development . 

o  Top  management  review  and  decisJon  concerning  a  major 
military  system  development  phase  before  proceeding  to 
the  next  phase. 

o  Formal  documentation  for  each  major  phase  and  written  top 
level  approval  to  proceed  to  invest  resources  for  the 
next  phase. 

o  Rigorous  testing  during  all  phases  of  development, 
o  Full  Scale  Development  (FSD)  time  for  major  weapon 

systems  is  similar  in  the  U.S.  and  USSR. 

DIFFERENCES 

The  principal  differences  between  the  U.S.  and  USSR  acquisition 
processes  in  the  major  areas  noted  previously. 
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National  Management  and  Budgeting 


The  Soviets  have  an  established  top  level  national 
weapons  oversight  organization,  the  Military 
Industrial  Commission  (VPK),  that  combines  certain 
functions  performed  in  the  U.S.  by  the  Department  of 
Defense  (DOD)  and  the  Congress,  as  well  ap  some 
functions  of  the  private  industrial  sector  Each 
major  program  phase  decision  is  staffed  thro,  jh  the 
VPK  which  reports  to  the  Council  of  Ministers,  and 
is  documented  in  Joint  Decrees  of  the  Council  of 
Ministers  which  have  the  authority  of  law. 

The  major  development  decision  made  to  approve  the 
resources  required  to  proceed  with  Full  scale 

Development  is  the  Defense  Systems  Acquisition 
Review  council  Milestone  II  ( DSARC  II)  in  the  U.S., 

and  in  the  Soviet  Union  it.  is  the  Joint  Decree  of 

the  Central  Committee  of  the  Communist.  Party  and  the 
Council  of  Ministers.  This  is  the  first,  and 

possibly  only,  major  approval  of  the  Soviet.  Union 
whereas  it  is  the  second  of  three  major  approvals  in 
the  U.S. 


U.S.  resource  commitments  for  defense  programs  are 
revisited  on  a  yearly  basis  because  of  Congressional 
approval  requirements,  while  Soviet  resource?  are 
committed  for  the  full  program  once  directed  oy  the 
issuance  of  a  Joint  Decree. 

A  major  segment  of  Soviet  industry  is  dedicated  to 
defense  work,  maintains  full  employment,  and  has  top 
national  priority  on  national  resources;  whereas 
U.S.  defense  contractors  must  compete  for  business 
in  market  conditions  that  have  wide  variations. 

The  top  level  people  involved  in  major  weapon 
acquisition  decision-making  remain  in  their 
positions  much  longer  in  the  USSR  than  in  the  U.S. 

As  a  result,  Soviet  major  military  development 
programs  tend  to  be  much  more  stable  than  U.S. 
development  programs. 

o  System  Design  Management  and  Style 

Higher  Soviet  program  security  makes  it  more 
difficult  for  both  other  Soviet  organizations  and 
the  U.S.  to  take  advantage  of  Soviet  knowledge  and 
developments . 

The  USSR  has  separate  design  and  production 
organizations;  in  the  U.S.  the  functions  are 

generally  integral  to  single  contractors.  ' 
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The  top  priority  of  Soviet  programs  is  to  meet  a 
preset  program  schedules;  while  the  top  priority  of 
U.S.  programs  is  technical  performance  in  order  to 
win  contracts. 

The  U.S.  tends  to  use  new  technology  for  each  new 
system  to  provide  maximum  technical  performance?  the 
Soviets  emphasize  extensive  use  of  technology 
transfer  to  keep  pace  with  the  technology  in  threat 
systems,  and  use  off-the-shelf  components  for 
producibility  considerations  to  help  meet  the 
program  schedule. 

Technology  freeze  occurs  in  the  USSR  programs  about 
the  time  the  Experimental  Design  Work  (OKR) 
Development  Phase  (Full  scale  Development.)  begins; 
while  it  is  years  later  in  the  middle  of  Full-Scale 
Development  in  U.S.  programs,  as  a  result  of  the 
above  priorities. 

There  is  greater  use  of  product  improvements  in  the 
USSR,  proceeding  in  parallel  with  new  developments. 
This  reduces  the  need  for  the  Soviets  to  push 
technology  in  each  development  program  since  if  the 
next  program  doesn't  achieve  desired  performance, 
the  one  starting  a  few  years  later  will  come 
closer.  In  addition,  the  phasing  of  product 
improvements  and  new  system  developments  allows  full 
employment  to  be  maintained  and  effectively  used  at 
the  major  design  bureaus. 


105 


